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(x'Vx)  (x'v”1  x)  where  x  is  an  n-vector  of  unit  length 
and  V  is  an  n*n  positive  definite  matrix.  Bloomfield, 
Watson  and  Knott  found  the  bound  to  | X* v X X’ V"1  X |  , 
and  Khatri  and  Rao  to  the  trace  and  determinant  of 
X'  VYY'V*"*X  where  X  and  Y  are  n*k  matrices  such 
that  X'X  «  Y'y  »  I.  In  the  present  paper  we  establish 
bounds  for  traces  and  determinants  of  X'VY  Y'V”  X  and 
X'BYY'CX  when  X  and  Y  are  matrices  of  different  orders. 
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ovich  inequality  and  a  number  of  new  results  of  independent 
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. 1 .  INTRODUCTION 

Let  V  be  an  n*n  positive  definite  matrix  with 
eigen  values  >  Ag  t  •••  >  *n  >  0,  and  define 

“  (Ai  +  An+i-l)2/4  Ai  An+i-l ’  1  a  1 . a(l  n/2)' 

Kantorovich  (1948)  established  the  inequality 

1<  (x'Vx)  (x'v'1x)/(x'x)2  <  o)j  (1.1) 

for  all  non-null  vectors  x.  A  natural  generalization  of 
(1.1)  is  to  compare  the  matrices  A =  (X'X)“1x' V X (X'X)”1 
and  8  *»  (X'v“*X)”*  when  X  varies  over  nvk  matrices 

of  rank  k.  Let  0j . 0.  be  the  roots  of  | A  -  0  B |  =0, 

i.e.,  the  eigen  values  of  A  with  respect  to  B.  It  is 
easy  to  establish  that  0^  >  ]  for  all  i.  Bloomfield 
and  Watson  (1975)  and  Knott  .(1975)  showed  that 

,  min(k.n-k) 

|AB’a  |  -  0, . 0.  <  n  w,  (1.2) 

1  K  i=l  1 

while  Khatri  and  Rao  (1980)  established  that 

tr(AB~^)»  0^+. . . +8^  <_  w^+.  . .  +d)^  if  n  >  2k 

<  +(2k-n)(  if  n  <  2k  (1.3) 

where  trC  represents  the  trace  of  matrix  C.  It  may  be 
noted  that  l  6^  =  tr  V  V’1  where  is  the  pro¬ 

jection  operator  on  the  column  space  of  X.  Bloomfield  and 
Watson  (1975)  gave  another  inequality 


tr  PxV(l-Px)V<i|  Ui-Vw)’  0.4) 

when  n  >  2  k  .  The  inequalities  (1.2)  -  (1.4)  are  useful 
in  comparing  the  efficiencies  of  simple  least  squares 
estimators  with  the  minimum  variance  unbiased  estimators 
of  parameters  in  the  Gauss-Markof f  model  (see  Khatri  and 
Rao,  1980). 

Khatri  (1978,  1980)  considered  the  matrix  (I  -  BA"1) 
which  arises  in  a  different  context  and  proved  the  follow¬ 
ing  results.  Let  i  *  (^  ,  ig ,  . . .  ,  in)  be  a  permutation 

of  (1,2 . n)  and  P  denote  the  class  of  all  permutations 

of  (l,2,...,n).  Further,  let 


Ci(a)  *  <X,  -  Xi  ,2/<Xi  *  Xi  )2 

xa  n-a+l  xa  Va+1 


(1.5) 


for  a  »  l,2,...,k  with  n  >  2k  .  Then 


-l  sun  min(k,n-k) 
|t-BA  h  <  s1(B) 


min(k,n-k)  (X.-X  ..,)' 

n  _ 1 _ P.TJ.li. 


J"1  (Xj+Xn-jU)4 


(1.6) 


tr  (I-BA”1)  <  l  C.(a)  if  n>2k,  (1.7) 


,r  n.-h-U  inf  r  F-l  if  n>2k.  (1.8) 

tr  (I-BA  )  >  ieP  ?i(0) 


Khatri  (1978)  further  showed  that  if 

c  -  x'vy  (Y’vyf^'vx  (X'vX)"1  (1.9) 
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where  Y  is  an  nxs,  (s<n-k),  matrix' such  that  X'Y  *  0, 
then 

|  C  |  <  1  Q  | ,  tr  C  <  tr  Q,  and  tr  C"1  tr  Q-1  (1.1' 

where  Q  *  I -BA"1.  Eaton  (1976)  established  the  results 
(1.6)  and  (1.10)  when  k»s«l. 

Strang  (1960)  generalized  the  Kantorovich  inequality 
(1.1)  in  the  form 

'  l 

f(x'Ay)  (y'A-1x)  /  (x'x)  (y'y)3  £  (1.1 

for  all  non-null  vectors  x  and  y  where  A  is  an  n  *  n 
nonsingular  matrix  with  singular  values  ^  1  ^2-’ ’ *-^n>  ® 
and 

«t  *  <5i  *  {n-t+l>2/4  Si  4n-i +1 ‘  (1-’ 

Greub  and  Rhe inbold t  (1959)  proved  that 

U'Oil»Hx'Ha»>  ^  (WW*  (1  . 

(x'GH  X;  “  -1  U„ 

for  all  non-null  vectors  x,  when  G  and  H  are  positive 
definite  commuting  matrices  with  eigen  values  ' * *— ^n>( 

and  Mi >Mo> • • • >  respectively.  The  result  (1.13)  can  be 
proved  using  (1.11). 

A  natural  generalization  of  tne  expression  in  (1.11) 


is  of  the  form 


(1.14) 


g(X,Y)  =  I  X'APy  A-1  X|  /I  X'  X  I 

or 

f (X, Y)  *  tr  <PxAPyA"1)  (1.15) 

where  X  and  Y  are  (n^k)  and  (  n  *  s)  matrices 
of  ranks  k  and  s  respectively  with  s.>  k,  and  A 
is  an  n  x  n  non-singular  matrix  with  singular  values 
*  * *  — ®n  When  s=k,  Khatri  and  Rao  (1980) 
established  the  inequalities 

min(k.n-k) 

g(X,Y)  <  n  w.  (1.16) 

i=l  1 

k 

f (X, Y)  <  l  u>.  if  n>2k 
i*l 

n-k  : 

<  l  w.  +  2k-n  if  n  <  2  k  (1.17) 

i-1  1 

where  are  as  defined  in. (1.12).  In  the  next  section 

we  establish  the  bounds  for  (i.14)  and  (1.15)  when  s  is 
not  necessarily  equal  to  k. 

We  also  consider  determinants  and  traces  of  matrices 

4 

of  the  type 

(X'G2  Y)  (Y'GH  Y)-1  (Y'H2  X)  (X’GH  X)"3  (1.18) 

which  are  natural  extensions  of  the  expression  in  (1.13) 
and  establish  bounds  under  very  general  conditions  on 
X,  Y,  G  and  H. 
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2.  THE  MAIN  THEOREMS 


In  all  the  theorems  stated  in  this  section,  X  and 
Y  stand  for  nxk  and  n  x  s  matrices  of  ranks  k  and  s 
respectively  with  s>  k  and  Pz  stands  for  the  projection 
operator  on  the  column  space  of  matrix  Z. 


Theorem  1.  Let  be  singular  values  of 

an  n*n  nonsingular  matrix  A,  and 

2 


<Wi+i>‘ 


46i  6n-i+l 


■,  i  -  1, .  .  .  ,m(  <n/2). 


Then 


|X'APVA“1X|  min(k.n-s) 

- 1 - <  n 


XX 


i  =  l 


and 


tr  (PyAPyA"1)  <  l 
x  Y  ~  i«l 


Mi 


if  n  >  s  +  k 


(2.1) 


(2.2) 


n-s 

£  )  +  (s+k-n)  if  n<s  +  k  (2.3) 

i"*l 


Note  1.  If  X^  and  Yj  are  n*(n-k)  and  n*(n-s)  matrices 
which  are  orthogonal  complements  of  X  and  Y  respectively 
then  (n-k)  >  (n-s)  and 


I  X'AP„  A“1X  I  lY^A'1  P„  A  Y,  I 


(2.5) 


tr  (PyAPvA_1)  =  (s  +  k  -  n)  +  tr  (Pv  A-1  Pv  A). 

X  Y  Y1  X1 

Hie  results  (2.4)  and  (2.5)  show  that  we  need  only  consider 
the  case  s^k  and  nj>s  +  k  in  proving  Theorem  1,  If 
r»<s  +  k,  then  n>^(n-s)  +  (n-k)  in  which  case  we  consider 
the  expressions  on  the  right-hand  sides  of  (^.4)  and  (2.5) 
and  apply  the  same  proof . 

Note  2.  If  A  ■  P  Dg  Q*  is  the  singular  value  decomposi¬ 
tion  of  A,  then  we  can  write  the  left-hand  side  expressions 
of  (2.2)  and  (2.3)  as 

|Xi  D6  Y+y;  D^Xjand  tr  (X;  D6  Y  Y;  D^1  X*)  (2.6) 

choosing  X*  «  P'X  (X'X)“*  and  Yt  *  Q'Y  (Y'Y)~^  so  that 
x;  X*  =  Ik  and  Y*  Y*  *  IgI  and  r>6  =  Diag( 6  , . . .  ,  6  ) 

(i.e.,  a  diagonal  matrix  with  <$^,...,Sn  as  diagonal 
elements).  In  view  of  (2.6),  we  need  only  prove  Theorem  1 
with  the  restrictions  X'X  *  I.,  Y'Y  =  I  and  A  is  a 

K  S 

diagonal  matrix. 

Theorem  2.  Let  X  and  Y  be  n  *  k  and  m  x  s  matrices 
of  ranks  k  and  s  respectively  with  k£s,  and  B  and  C 
be  nxm  and  m*n  matrices  such  that  C  »'  B+  (the  Moore- 
Penrose  inverse  of  B,  see  Rao,  1073,  p.  26).  Further, 
let  ^j^2—  ’  *  ^t>^)  t*ie  nonzero  singular  values  of  B 

and  t>^s.  Then 

|x'BPv  C.I  I  rnin(k.t-s) 

- - -  <  n  w  (2.7) 

I X  X |  i-1  1 
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and 


tr  (PxBPy  C)  <  Z  m  if  t>s  +  k 

t-s 

<  s  +  k  -  t  +  l  o).  if  t<s  +  k  (2.8) 
i-1  1 


where  -  (Sj *  «t.i+1)2/4«i  «t.1+r 

Theorem  3.  Let  V  and  W  be  nxn  and  mxm  non-negative 
definite  matrices,  and  X  and  V  be  nxk  and  mxs  mat¬ 
rices  such  that  X'VX  and  Y'VY  are  positive  definite; 
Further,  let  B  and  C  be  nxm  and  mxn  matrices  such 
that 

(a)  t  -  R(B)  -  R(C)  <  s 

(b)  p(W)  -  p  (®)  -  p  (C:V),  p(V)  -  p(B:V)  -  p(§) 
where  p(A)  stands  for  the  rank  of  matrix  A. 

(c)  BW+  C  and  CV+B  are  symmetric  of  rank  t 
and  B  W+  C  V+  B  *  B . 

2  2  2 

If  6^  >  >  ®  are  the  nonzero  eigen  values  of 

BW  B*  V  and  uk  »  ( +  St-i+l ^2/4  5 1 - i  +1  then 


I X *  B  Y(Y’W  Y)  ~1  Y'C  Xl 
| X*  V  Xj 


min(k , t-s) 

<  n  to 

i-l 


(2.9) 


and 


trCfX'vX)”1  X’B  Y  (Y'w  Y)"1  y'CX]  <  £  at.,  if  t>s  +  k 

i  =  1  1 

t-s 

<  (s+k-t)+  l  m  ,  if  t<s+k. 
i=l 

(2.10) 
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Theorem  4 .  Let  S  and  R  be  n  x  m  and  m  x  n  matrices 

such  that  t  «  p(S)  =  p(R)  =  p(SR)  with  t^s^k,  and 

SR  and  RS  are  symmetric,  nonnegative  definite  and  idem- 

potent  matrices.  Further  let  6^>  Sgil*  •  *21^  >  0  be  the 

2 

nonzero  singular  values  of  S  and  ai^C  5i+<^t~i+l^  /4<Si^t-i+l* 
Than 


1  X1  S  Y(Y’RS  Y)"1  Y’  R  X I  <  min(.k ,  t-s)^ 
|  X's R  X  !  ,  i*l 


and 


tr[(X'S  R  X)“1X'  S  Y(Y'RS  Y)"VrX1 

k 

<  l  to.  if  t  >s  +  k 
i=l  1 

t-s 

£(s  +  k~t)  +  J  u».  if  t  <  s  +  k.  (2.12) 
"  •  j«i  1 


Proof .  Theorem  4  follows  from  Theorem  2  by  choosing  V  =  SR, 
W  «  RS,  B  «  S  and  C=  R. 

Theorem  5.  Let  G  and  II  be  symmetric,  and  commuting 

matrices  such  that  GH  is  nonnegative  definite  and 

p(G)  -  p(H)  *  p(G  H)  ■=  t>^s>^k.  Further  let  6^  ^  &2— '  '  ’  — ^t>  ® 

i 

be  the  nonzero  eigen  values  of  H~G  where  H~  is  any  g 

2 

inverse  of  H,  and  wi  =  (  +  5f,_  t  +  i )  /^i^t-i+l '  Then 

I  X*  G2  Y  (Y'GII  Y)~V  H2  X|  <  rn3n(i5’t"R)w 
lx'  G  H  xl  ~  i - 1 


(2.13) 


tr[(X'  G  HX)"1  X'G2  Y  (y’gH  YTVh2  XI 

k 

<  l  a),  if  t  >  k  +  s 
i=l  1 

t-s 

<  (k  +  s-t)  +  l  w,  if  t  <  k  +  s.  (2.14) 

i=l  1 

Proof .  Theorem  5  follows  from  Theorem  3  by  choosing 
V  »  W  «  GH,  B  «  G2  and  C*H2. 

Theorem  6.  Let  V  and  W  be  positive  definite,  and  B 
and  C  be  two  matrices  such  that  p(B)  «  p(C)  «  t(_>  s), 

BW~*  C  and  CV-"*  B  are  symmetric  and  BW~*CV~*B  *  B. 
Further  let  >  0  ^e  the  nonzero  singular 

values  of  V”1  B(W^)"1  where  W«WjWj  and  V-V^j. 

Then  the  inequalities  (?  ^).  and  (2.10)  hold. 

3.  PROOFS  OF  MAIN  THEOREMS 

Proof  of  Theorem  1.  The  proof  depends  on  a  number  of  lemmas 

which  are  also  of  independent  interest..  As  observed  in  notes 

1  and  2  following  the  statement  of  Theorem  1,  we  can  take  X 

and  Y  such  that  X  X  *  1^,  Y  Y  *»  Ig>  n^s  +  k  and  A  as 

/ 

Dg  «  Diag( 6^ t . . . , 6  )  with  all  6^  positive. 

Lemma  1 .  Let  V  be  an  n.n.d.  matrix  or  order  n  with  non¬ 
zero  eigen  values  Aj  Ag>.  .  •  >  AR  >  0  and  X  be  an  nxk 
matrix  of  rank  k(<s).  Then 


(3. 


SUp  .IJLVX.L  a  h  A.  and  sup  tr(PxV)  »  l  A. 
X  j  X' X |  i=l  1  X  i=l 


Proof .  The  result  (3.1)  is  an  immediate  consequence  of 
the  Poincar€  Separation  Theorem  (see  Rao,  1979,  p.  364) 
which  states  that 

pi  -  *i*  i  *  1 . .  (£s)  (3. 

where  p^,  i  »  1,2,...  are  the  roots  of  the  determinantal 
equation 

|X'VX-  P  X’X  |  «  0  (3. 


and  the  equality  in  (3.2)  is  attained  for  a  suitably 
chosen  X. 


Lemma  2.  Let  X  and  Y  be  n  x  k  and  n  *  s  matrices 
such  that  x'x  «  1^,  Y'Y  *  Ig  and  s>_k.  Let  be 

a  positive  definite  diagonal  matrix  and  A  >A0>...>A  >  0 

J  S 

be  the  eigen  values  of  (Y'D^Y)  (YD^1  Y)  .  Then 


(3. 


(3. 
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s  and  its  eigen  values  are  A^  A2^.  . .  >Ag  >  o .  Then,  again 

applying  the  result  (3.1)  to  the  expression  on  the  right 

* 

hand  side  of  (3.8),  we  have  from  (3.7) 


,  2  ,  k 

|X'Dg Y  Y’D~A  X|  <  |X'Dg  x|  *  |xVl  X|  (  n  Ai) 

which  proves  (3.4). 
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p. 


Proof  of  (3.5).  Consider  the  singular  value 
decompositions 

D“1XX'd  =  Tx  Dx  Tg  and  DYY'd"1  =  Tg  Dg 

where  Tj,  Tg,  Tg  and  T^  are  orthogonal  matrices  and 
D^  and  Dg  are  diagonal  matrices  such  that 

Dj-DiagCgj . 6k,  0,...)  and  Dg  »  Diag(  Yx , . . . ,  Yg  ,  0,...), 

where  0^. .  .>8^  >0  and  .  .^y2  ?  0  •  Then  using  a  theorem 

of  von  Neumann  (see  equation  (2.11)  in  Rao,  1979), 

tr(PxD6  PyD”1)-  tr(D1  Tg  Tg  Dg  T^ftrD^g  (3.9) 

and  the  equality  holds  iff 


T2T3" 


Jk  0 
0  A, 


and  T4  Tj 


1'  • 


‘k  0 
0  A, 


where  Aj  and  Ag  are  arbitrary  orthogonal  matrices. 


Now, 


k  t  k 


k  r  k  n\  ~  /  k  9\- 

tr  D]  Dg  =  l  <  I  f  l  fl*  , 
J  *  i*l  1  1  4=1  ■’  4=1 


■lA  -  tr(px  Ds  px  “s1’ 

1=1 


(3.10) 


and  *  y*,  i  *  l,...,s  are  the  nonzero  eigen  values 


of  Py  Ds  PY  D-1 


Hence  using  (3.10)  in  (3.9)  we  get 
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which  proves  (3.5).  Thus  Lemma  2  is  established. 

Lemma  3 .  Let  X^  Xg^ . .  .>_X  >  0  be  the  eigen  values  of 
Y  yy'  D^Y  where  Y  is  an  nxs  matrix  such  that 
Y'T  *  Ig  and  diag  ■  ( 6^ , . . . , )  with  all  6^  positive, 

and  ut  -  («i*«n.i+l>2/44i{n-l+l  for  111 . *<£»>• 

Then  ' 


k  k 

II  X.  <  IT  u.  and 
i-1  1  “  i-1  1 


<  l  v 

i»l  1 


Proof .  Let 

♦(B)  -  |B'Y’  Dfi  Y  B|  /  |b'(Y'  D'1  Y.r1  B| 
Y(B)  -  trtB'y' D6  YB  (B^Y'D”1  Y)"1  B)'1] 


(3.11) 


(3.12) 


where  B  is  an  sxk  matrix  with  p(B)  *  k£s.  Then 
applying  (3.1) 

k  k 

sup  4»( B)  «  il  X.  and  sup  H'(B)  <  l  X.  (3.13) 

B  i»l  1  B  i=l  • 


Next  we  observe  that 

B,(Y’D^1Y)”1B  -  B,B(B,Y,D"1YB)"1B'B  (3.14) 

is  non-negative  definite,  (see  example  33  on  p.  77  of  Rao, 
1973).  Then,  substituting  the  second  expression  in  (3.14)  for 
the  first  in  (3.12),  we  get 
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<KB)  <  j  (YB)'D6(YB)  I  |(YB)’D"1(YB)  1/  |(YB)‘(YB) 


nB)  <  tr{(YB)'D5(YB)l  (YB)'YB  f'l(YB),D“1(YB)l  (YB)'(YB)  f 1  .  (3.15) 

Now,  writing  YB  *  L  which  is  of  rank  k  and  applying  the 
inequalities  (1.2)  and  (1.3)  to  the  right  hand  sides  of  (3.15) 


we  have 


k  k 

4>(B)  <  II  a',  and  'i'(B)  <  1  w. 

i»l  ”  i«=l  1 

which  in  conjunction  with  (3 . 13) proves  (3.11),  since  uk 
are  independent  of  B. 

Combining  the  results  (3.4)  and  (3.11)  we  get 

i  ^  j  -it 

lX’DgYY’D^Xl  <  (  n  k^)"  IX'D^XX'n"  x|l; 

i*l 

tr(X'D6YY'D‘1X)  <  (  \  'wi)i(trX,DfiXX'Dj1X)'J  .  (3.16) 


A  further  application  of  (1.2)  and  (1.3)  to  the  right  hand 
side  expressions  of  (3.1G)  proves  Theorem  1. 

Proof  of  Theorem  2.  Consider  the  singular  value  decomposi¬ 
tion,  B  *  Aj  Ag  where  A|  -  lt  for  i»l,2  and 
=  Diag(  6^  , . . . ,  6j.)  with  all  6i  positive.  Then 
C  =  B+  ■  A0  d:!a;.  Let  X  =  A*  X  and  V  =  t\'\  so  that 

X'X-X’  X^  and  y'y-Y'  Y  are  n.n.d.  matrices  and  so  also 
o  o  o  o 


pvo  -  y„<y'Y>'1’f,;  \  - 


Then  it  is  easily  seen  that 


|X'BPyCX|2  |X;DsPy  D-1Xoi 


|X'X|: 


X  X 
O  O 


tr(PxBPYC)  <  tr(Px  Ds  py  D-1).  (3. 


Now  using  Theorem  1  on  the  right  hand  side  expressions  of 
(3.17)  and  (3.18),  we  get  the  results  (2.7)  and  (2.8)  of 


Theorem  2. 


Proof  of  Theorem  3.  Let  V  and  W  be  of  ranks  and 


ml  respectively  and  write  V  *  vj  and  W  »  w  wj  where 
Vj  and  are  n  y  and  m  *  matrices  of  ranks  nj 

and  respectively.  Let  • 


B1  "  ( vi  V1 )  1  vi  B  W1(Wj  Wj)'1  and  »  (Wj  Wj  )“1W^  C  Vj(  VjVj  )-1 

Then,  under  the  given  conditions,  it  Is  easy  to  verify  that 
Cj  *  Bj  and  taking  Xo  -  vj  X  and  Y()  »  Y^Y, 

x,BY(Y'»Y)'1Y'cx  *  x;B]  vo(y<;yo)“1  V^Cj  xo'  (3.. 

and  x'vx  »  X^  XQ.  Now  applying  Theorem  2  to  the  right- 
hand  side  expression  of  (3.19),  wo  get.  the  results  of 

Theorem  3. 
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